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HEBBIAN SYNAPSE CIRCUIT 



CROSS REFERENCE TO RELATED APPLICATIONS 

This application claims priority from U.S. Patent Application No. 09/332,790, 
5 filed on June 14, 1999, which claims priority from U.S. Provisional Patent 

Application No. 60/090,069 filed June 19,1998, both of which are incorporated herein 
by reference in their entirety 

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH 
1 0 Not applicable. 

FIELD OF THE INVENTION 

This invention relates generally to electrical circuits and more particularly to 
circuits that model the behavior of biological neurons. 

15 

BACKGROUND OF THE INVENTION 

As is known in the art, there exists a class of networks referred to as neural 
networks which model the behavior of certain human functions. Electronic neural 
networks have been used to implement mathematical or engineering abstractions of 

2 0 biological neurons. Circuits emulating biological neurons are typically implemented 
using digital circuits that operate up to a million times faster than actual neurons or 
with software which simulates the behavior of a biological neuron. One problem with 
the digital circuit approach, however is that it does not utilize life-like principles of 
neural computation. Furthermore, a biological nervous system contains thousands or 

2 5 millions of interconnected neurons and thus the complexity of a biological nervous 
system results in a complex digital circuit. 

Similarly, given the complexity of the biological systems, software simulations 
can take many hours or days even using presently available state-of the-art processing 
30 systems. Thus software systems are not appropriate for use in applications which 
require real time or close to real time performance from such systems. 
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An electronic circuit that emulates the analog behavior of actual biological 
neurons, on the other hand, can perform simulations in real time. Thus, to overcome 
the above limitations with systems implemented using digital circuits or software, 
5 electronic circuit neural networks which use principles of neural computation which 
are more life-like than the digital circuit or software approaches have been developed. 

This type of neural network interacts with real-world events in a manner which 
is the same as or similar to biological nervous systems and can be utilized in a variety 
10 of systems including but not limited to electronic and electromechanical systems, such 
as artificial vision devices and robotic arms. Such neural networks can also be used as 
research tools to better understand how biological neural networks communicate and 
learn. 



15 Much of the effort directed toward producing electronic implementations of 

biological neurons have focused on emulating the input-output functional 
characteristics of the neuron, essentially treating the neuron as an abstracted black 
box. These implementations focus on circuits and techniques for generating an action 
potential in an attempt to simulate the actions neurons take to communicate with one 

2 0 another. One problem with past approaches, however, is that such approaches fail to 
properly take into account or model the means which actually produces the action 
potential in a biological neuron. 



Some prior art techniques have produced analog integrated circuits that mimic 

2 5 the functional characteristics of real neuron cells, by isomorphically emulating the 

membrane conductances within an actual neuron cell body. Thus, one problem with 
prior art approaches is that they fail to include circuitry for the synapse through which 
neurons communicate and/or the prior art approaches fail to include circuitry for the 
dendrite which is the connection between the synapse and neuron cell body. Prior art 

3 0 systems also fail to include effective circuitry to implement the adaptation or learning 

functions of real neurons. 
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As known to one of ordinary skill in the art, a neuromorphic system emulates 
the functionality and organization of a biological nervous system on an integrated 
circuit. Neuromorphic systems typically include analog electronic circuits with digital 
5 circuitry to enhance and support their function. Fabrication of these neuromorphic 
circuits is most often done in a complementary-metal-oxide-semiconductor (CMOS) 
process using very large-scale integration (VLSI) technology. 

Neuromorphic systems directly embody in the physics of their analog CMOS 
1 0 circuit building blocks so-called isomorphisms of the biophysical processes. Neural 
computational primitives like amplifying, exponentiating, thresholding, integrating, 
taking the sigmoidal function of, and storing charge, can thus be efficiently performed 
in a real-time analog fashion using compact low-power CMOS circuits designed 
specifically for these purposes. 

15 

Digital computing paradigms in other fields of science and engineering has led 
to their use in simulating nervous systems. Digital simulations by themselves, 
however, require huge and complex Boolean logic functions encode fundamentally 
analog neural computational primitives, such as those mentioned above. Thus, the 

2 0 modeled system must be translated into an explicitly mathematical form. This is 

grossly inefficient in terms of time and number of transistors required to execute a 
neural computation. Significantly, the natural temporal relationship between neuronal 
processes is not preserved in a digital simulation on a computer thereby preventing 
real time interaction with the real world in a manner analogous to that of biological 
25 nervous system. 

Animal nervous system are capable of learning and remembering. One simple 
type of learning involves the interaction of two neurons, as shown in FIG. 1. Learning 
occurs when there is an alteration of the synaptic transmission strength from the 

3 0 presynaptic neuron's axon terminal to the postsynaptic neuron's synapse head. A 

synapse whose strength can be modified by neuronal activity is said to be plastic, and 



the general phenomenon is known as synaptic plasticity. When neuronal activity leads 
to an increase in synaptic transmission strength, the synapse is said to have become 
potentiated. And when this stimulation leads to a decrease in strength, the synapse is 
said to have become depressed. If these changes are subsequently retained, the 
5 "learned" information is "remembered" by the synapse. Potentiation that is retained 
for a long period of time after neuronal activity has ceased is known as long-term 
potentiation (LTP). Likewise, depression that is retained for a long period of time 
after neuronal activity has ceased is known as long term depression (LTD). Both of 
these phenomena have been shown to occur in the various regions of the brain. 

10 

One known electrical model that attempts to explain the biophysical behavior 
of a Hebbian synapse is shown in FIG. 2. Examining the simple two-neuron system 
of FIG. 1, when the presynaptic neuron fires an action potential, its axon terminal 
release neurotransmitters. These neurotransmitters pass through the synaptic cleft and 

15 bind to receptors on the synapse head. This causes NMDA and non-NMDA ion 
channels to open up. The NMDA ion channel passes an electric current, which 
consists primarily of Ca 2+ ions. This postsynaptic influx of Ca 2+ ions plays a pivotal 
role in the expression of synaptic plasticity. Upon entering the synapse head, Ca 2+ 
ions set in motion a series of events that ultimately leads to the induction and 

2 0 maintenance of LTP and/or LTD. 

FIG. 3 shows how the level of calcium concentration that has accumulated 
inside of a synapse operates to change the long-term plasticity. The non-NMDA ion 
channels pass a current which, in contrast to the NMDA channels, consists mainly of 
2 5 Na + ions (with a negligible Ca 2+ component). The total synaptic current that flows 
through the membrane thus consists of the sum of (1) the NMDA current, and (2) the 
non-NMDA current; plus (3) a small leakage current, and (4) a capacitive current that 
flows when the head membrane voltage is changing. 



30 



The leakage conductance ghead is constant while the non-NMDA conductance 
gnon-NMDA is dependent on the time that elapses after an action potential excites the 
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synapse. It is given by the following alpha-function 



( 



S non-NMDA 

(0 = Kg/exp - 



V P J 



where K=e/t p , e is the base of the natural logarithm, t p =l .5ms, and the peak 
5 conductance g p =0.5nS. The concentration of calcium within the synapse also 

modulates this conductance, and that this is the biophysical mechanism by which LTP 
and LTD are expressed 



1 0 also depends on the time that elapses after an action potential excites the synapse. 
However, there is an additional dependence on the synapse head membrane voltage 
Vhead, and there is no dependence on calcium concentration. In this case, the 
conductance is a sigmoidal function 



1 5 where xi=80msec, T 2 =0.67msec, r|=0.33/mM, y=0.06mV, and g^O^nS. When V hea d 
is near its resting potential, the NMDA ion channel conductance is close to zero and 
little Ca 2+ enters the cell. Excitation by action potentials from the presynaptic neuron, 
however, causes the conductance of the non-NMDA ion channels to increase. This 
allows an influx of Na + ions into the synapse head which charges up the membrane 

2 0 capacitance Ch and increases the membrane voltage Vhead- The increase in Vhead in turn 
causes the conductance of the NMDA channels to rise from zero, allowing an influx 
of calcium ions that induces LTP and/or LTD or neither, as shown in FIG 3. 

Three broad types of LTP and LTD may be distinguished: hemosynaptic, 
2 5 associative, and heterosynaptic. Homosynaptic LTP and homosynaptic LTD occur in 
isolated synapses, such as the 2-neuron system of FIG. 1. Homosynaptic LTP is 
induced when a single synapse is subjected to a burst of high frequency action- 



Like the non-NMDA conductance g non -NMDA 5 the NMDA conductance gNMDA 




5 



potential stimulation from a presynaptic neuron. This type of LTP can be thought of 
as a sort of microscopic "practice makes perfect." That is, memory is reinforced 
through repeated use of the synapse. 

5 Homosynaptic LTD, on the other hand, occurs when the synapse is subjected 

to a long period of sustained low frequency stimulation. While it may not be intuitive 
that repeated use of a synapse even at low frequencies result in a synaptic depression, 
the biological significance makes sense if one considers this sort of LTD to be a 
microscopic "getting so use to something you forget about it". As an example, 
1 0 consider the buzzing of fluorescent lights. To someone not used to working in a room 
with them, they can be quite distracting. But after awhile, this sensitivity disappears. 

FIG. 4 summarizes the experimentally determined long-term plasticity 
behavior of a synapse, e.g. the simple two neuron system of FIG. 1, when it is 
15 subjected to a range of presynaptic action potential frequencies. The synaptic strength 
is a result of the operation of Ca 2+ within the synapse, as described above. 

It would, therefore, be desirable to provide a neuromorphic circuit that 
emulates homosynaptic long term potentiation and long term depression. 

20 

SUMMARY OF THE INVENTION 

In accordance with the present invention, a circuit which implements functions 
of a biological nervous system includes a plurality of neuron circuits and a plurality of 
synapse circuits. The synapse circuits are coupled to provide a path through which the 

2 5 plurality of neuron circuits communicate. Each of the plurality of neuron circuits 
include (1) a neuron cell membrane circuit, (2) a learning circuit coupled to said 
neuron cell membrane circuit; and (3) a dendrite circuit coupled to the neuron cell 
membrane circuit. Each of the synapse circuits include means for modifying the 
synaptic conductance With this particular arrangement, a neuron circuit which 

30 models a biological neuron circuit and in particular which emulates the neuron 
synapse is provided. By providing the neuron circuit with circuitry which allows 
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adaptation or learning function to be performed, the neuron circuit of the present 
invention more closely models a biological neuron than prior art systems. The 
synapse circuit includes an NMDA channel circuit which is coupled in parallel with a 
non-NMDA channel circuit between first and second terminals of the synapse circuit. 
5 Also coupled in parallel between the first and second terminals of the synapse circuit 
in parallel with the NMDA and non-NMDA channel circuits is a storage element. The 
non-NMDA channel circuit controls the induction of LTP and LTD in the neuron 
circuit thereby emulating the response to a neurotransmitter in a biological neuron. In 
particular, the induction of LTP is characterized by a prolonged increase in the 

1 0 conductance of the non-NMDA receptor channel, while the induction of LTD is 
characterized by the decrease in conductance of the non-NMDA receptor channel. 
The NMDA channel circuit provides a current which is approximately proportional to 
the flow of magnesium ions (Ca 2+ ) into the spine head. The NMDA circuit emulates 
the response to the neurotransmitter. This controls long term memory effects in 

1 5 biological systems. The response to the post-synaptic neuron gives a pairing effect 
meaning that an NMDA receptor receives signals from both pre- and post- synaptic 
neurons and provides a response thereto. In a biological neuron, non-NMDA 
"channels" carry sodium ions (Na*) which are abundant while NMDA "channels" 
regulate the flow of calcium ions (Ca 2+ )to the neuron. The calcium is the internal 

2 0 messenger. Once the calcium travels into the cell body, it triggers chemical reactions 
(referred to as "secondary messengers") in the post-synaptic cell. These secondary 
messengers affect the non-NMDA channels by increasing or decreasing the 
transmission in the channel. The neuron circuit of the present invention emulates the 
calcium influx via the NMDA channels and generates a signal which controls the 

2 5 response of the non-NMDA circuits by controlling the number of channels in those 

circuits which are open or closed. 

In accordance with a further aspect of the present invention, an integrated 
circuit which implements functions of a biological nervous system includes circuits 

3 0 designed to emulate the electrical characteristics of actual neurons. In particular, the 

circuits emulate the neuron cell membrane, the dendritic structure, and a synapse. In 
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one embodiment, one particular type of synapse referred to as a Hebbian synapse is 
modeled. These circuits are more neuromorphic compared to most analog neural 
networks. The neuron cell membrane circuits include circuitry to represent the 
sodium and potassium ion channels in the membrane. The synapse circuits include 
circuit portions which correspond to different types of synaptic current channels. 
Moreover the neuron circuit design of the present invention includes circuits which 
modify the synaptic conductance, or strength of the neuron through a feedback 
mechanism. With this particular technique, an analog CMOS circuit implementation 
of an electrical model of a biological synapse is provided. In particular, the circuits 
emulate the synaptic modification, the learning mechanism, exhibited in certain types 
of neurons. This can be used in an artificial neural network that emulates neural 
computation in a manner which is more realistic than conventional electronic artificial 
neural networks. In one embodiment, the integrated circuit of the present invention is 
implemented using CMOS circuits. 

In accordance with another aspect of the invention, an LTP/LTD controller 
circuit includes a circuit for controlling the conductance level of the synapse circuit. 
The conductance level corresponds to the number of conductive pathways associated 
with a non-NMDA ion channel circuit. Each of the conductive pathways includes a 
switching element that has a conduction state determined by a respective control 
signal. In one embodiment, the controller circuit includes a counter that loads the 
conductance value of a synapse, i.e., the number of conductive pathways, which is 
determined by the switching element control signals. The counter increments, 
decrements, or does not change, the synapse conductance value based upon the state 
of a plurality of counter control signals that correspond to the synapse calcium 
concentration level. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing features of the invention, as well as the invention itself may be 
more fully understood from the following detailed description of the drawings, in 
which: 
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FIG. 1 is a block diagram model of a synapse circuit; 

FIG. 2 is a circuit diagram of a prior art model of a Hebbian synapse; 

5 

FIG. 3 is a pictorial representation of the relationship between synapse calcium 
concentration and LTP/LTD; 

FIG. 4 is a graphical depiction of the percentage change in synapse strength 
1 0 versus the log of stimulation frequency; 

FIG. 5 is a block diagram of a synapse circuit; 

FIG. 6 is a block diagram of a synapse circuit having a pair of receptor 
1 5 channels and a storage element; 

FIG. 7 is a block diagram of a calcium concentration measurement circuit; 

FIG. 8 is a block diagram of a storage and buffer circuit; 

20 

FIG. 9 is a block diagram of a threshold detection circuit; 

FIG. 10 is a block diagram of a non-NMDA receptor channel circuit; 

2 5 FIG. 1 OA is a block diagram of a cascaded follower-integrator circuit; 

FIG. 1 OB is a block diagram of a time-varying current circuit; 

FIG. 10C is a plot of non-NMDA current in response to one pre-synaptic 
30 stimulus vs. time; 



FIG. 10D is an exemplary alpha function circuit; 

FIG. 1 1 is a block diagram of an NMDA receptor channel circuit; 

5 FIG. 1 1 A is a plot of NMDA current in response to one pre-synaptic stimulus 

vs. time; 

FIG. 12 is a block diagram of an LTP/LTD circuit; 
10 FIG. 13 is a plot of calcium level vs. gain in non-NMDA receptors; 

FIG. 13A is a block diagram of an LTP/LTD reversal circuit; 
FIG. 14 is a block diagram of a bias circuit; and 

15 

FIG. 14A is a schematic diagram of a scaling circuit; 

FIG. 15 is a block diagram of a neuromorphic control circuit for a Hebbian 
synapse in accordance with the present invention; 

20 

FIG. 15A is a circuit implementation of a non-NMDA ion channel circuit 
having a conductance level controlled by the control circuit of FIG. 15; 

FIG. 15B is a block diagram of a neuromorphic control circuit for controlling a 
2 5 plurality of Hebbian synapses in accordance with the present invention; 

FIG. 16 is an exemplary circuit implementation of the control circuit of FIG. 

15; and 

30 FIG. 17 is a pictorial representation of the LTP/LTD process in relation to first 

and second voltage thresholds that can form a part of the circuit of FIG. 15. 
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DETAILED DESCRIPTION OF THE INVENTION 

Before describing the apparatus and processes for providing a neuron circuit, 
some introductory concepts and terminology are explained. The biological neuron is 
5 the basic anatomical unit of a biological nervous system. It includes a cell body 
equipped with a tree of filamentary structures called dendrites. The dendrites are 
covered with structures called synapses. The synapses act as junctions through which 
are formed connections with other neurons. The synapses are the primary information 
processing elements in neural systems. The dendrites sum the synaptic inputs from 

1 0 other neurons, and the resulting currents are integrated on the membrane capacitance 
of the cell body until a signal threshold level is reached. At that point, an output 
neuron pulse, called the action potential, is generated and then propagates down the 
neuron's axon which is a relatively long structure used to transmit data. The end of 
the axon consists of a tree-shaped structure of synaptic contacts that connect to the 

1 5 dendrites of other neurons. 

The electrical activity in a neuron cell body occurs in the thin membrane that 
electrically separates the neuron's interior from exterior fluid. An energy barrier is 
formed by the cell membrane that is so high that few ions are able to surmount it. 
2 0 Inside all cell membranes are metabolic pumps that actively expel sodium ions from 
the cytoplasm while importing potassium ions from the extra-cellular fluid. Typical 
concentrations of these ions inside and outside the cell are shown in Table I below. 



TABLE I 



Ion 


Concentration 
Inside (mM/l) 


Concentration 
Outside (mM/l) 


Reverse Potential 
(mV) 


Potassium (K+) 


400 


10 


-92 


Sodium (Na+) 


50 


460 


55 


Chlorine (C1-) 


40 


540 


-65 
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The concentration gradient that exists across the membrane is used to power 
electrical activity. Ions diffuse in/out, respectively, of the membrane while electrically 
drifting out/in. 

When the voltage across the membrane reaches the reverse potential V r the 
diffusion of ions will be exactly counterbalanced by the drift of ions. The reverse 
potential V r may be computed as shown in Equation 3 below: 

V r = In —a- 1 Equation 3 

9 ™ ex 



10 The reverse potentials for the three ions in the membrane are shown in Table I. 

In operational terms, the sodium reverse potential may be thought of as a positive 
power supply rail and the potassium reverse potential as the negative rail. 



I mem = " V K )G K + (V Na - V mem )G Na + (V cl - V mem )G a Equation 4 

The electrical characteristics of the cell membrane may be represented as four 
15 parallel legs of a circuit. Three of the legs include a voltage source representing the 
reverse potentials of the ions, and with a conductance which represents the membrane 
permeability for that ion. The membrane capacitance is represented as the fourth leg 
and can be depicted as a lumped capacitor. For a given membrane voltage, the current 
through the membrane (i.e., the capacitor current) can be expressed as: 

20 

Any net current will charge or discharge the membrane capacitance until the 
current is reduced to zero. Under normal conditions, the chlorine current is small and 
can be neglected. With this assumption, the voltage at which the net current is zero 
can be expressed as: 

25 
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Vq m VKG K +V Na G Na Equation 5 

G K+ G Na 

in which V 0 represents a so-called resting potential and is typically equal to a voltage 
5 of about -85 millivolts (mV), although it can vary considerably. A neuron at rest is 
termed "polarized" to a negative potential and when the membrane potential becomes 
more positive the neuron is said to become depolarized. 

There are a number of different potassium ion currents. The delayed rectifier 
1 0 current, IKD, along with the sodium current, generates the neuronal impulse. Two 
other potassium currents with slower dynamics, the so-called A-current (IKA) and the 
calcium dependent potassium current (IAHP or after-hyperpolarizing current), control 
the rate at which impulses are produced. 

15 The activation and inactivation of the ion conductance in the membrane are 

themselves dependent on the membrane voltage and time. There is a sigmoidal 
relationship between the ion conductance and the membrane voltage. This creates a 
thresholding behavior that is responsible for the generation of the neuron pulse, or 
action potential. As the membrane becomes depolarized (in response to, for instance, 

20 an influx of synaptic current), there is a transient in the sodium conductance, followed 
by a delayed but prolonged increase in the potassium conductance. The currents 
through these conductance paths create the action potential. 

In traditional analog CMOS circuits, the transistors are biased in the 
2 5 saturation, or strong inversion, region of operation, where the drain current is given by 
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l DS s 



~(V GS -V t ) 2 (l^XV DS ) 



Equation 6 



where k' is a physical parameter, W/L is the ratio of the transistor channel width to 
channel length, Vgs is the gate-to-source voltage, V t is the threshold voltage of the 
5 transistor, X is the inverse of the Early voltage of the transistor, a parameter related to 
the output resistance of the device, and V DS is the drain-to-source voltage. For XV D (S)» 
1, the current is roughly independent of the drain-to-source voltage. 

In prior art systems, the transistor is not used in the subthreshold, or weak 
10 inversion, region of operation. In this region, the current levels are very small and the 
drain current varies exponentially with the gate voltage as shown by Equation 7: 



in which k x and n are fabrication dependent parameters and V T is the thermal voltage, 
which is approximately 26 millivolts at room temperature. For drain-to-source 
15 voltages greater than a few thermal voltages, the drain current is essentially 
independent of the drain-to-source voltage. 

Many of the circuits described herein utilize transistors biased in the 
subthreshold region, to take advantage of the exponential relationship between current 
2 0 and voltage, which is prevalent in actual neurons. CMOS technology is used instead 
of bipolar technology because of the greater availability of CMOS processes. Also, 
the current levels, and hence time scales, of subthreshold CMOS transistors match up 
fairly well with the actual biological levels. Additionally, the nearly infinite resistance 
of the MOS gate is useful in many circuits. It should be noted, however, that in some 




Equation 7 
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applications bipolar or some technology other than CMOS technology may be 
preferred. Regardless of the particular technology used to fabricate physical devices 
or circuits which implement the functions and techniques of the neuron and synapse 
circuits described herein, the principles of the invention described herein still apply. 

5 

Referring now to FIG. 5, a synapse circuit 20 includes a threshold detection 
circuit 22 having a first port 22a coupled to a first port 20a of the synapse circuit 20 
and a second port 22b coupled to a first port 24c of a signal conversion and formatting 
circuit 24. A second port 24b of the signal conversion and formatting circuit 24 is 
1 0 coupled to a first port 26a of a storage device 26. The storage device 26 may include 
both an analog storage device for short term memory and a digital storage device for 
long term memory. A second port 26b of the storage device 26 is coupled to a second 
port 20b of the synapse circuit 20. 

15 In operation, the synapse circuit 20 receives one or more signals at port 20a. 

In response to the one or more signals, the threshold detection circuit 22 provides at 
port 22b a response signal having a response signal level dependent upon the signal 
level of the signal received at port 22a. The response signal is provided to signal 
conversion and formatting circuit 24 which converts the signal to a digital format and 

2 0 appropriately formats the signal for storage in the storage device 26. 

Referring now to FIG. 6, an alternate representation of synapse circuit 20 is 
shown to include parallel signal paths 21a-21c. In this embodiment, a storage element 
32 has a first port coupled to synapse port 20a and a second port coupled to synapse 
2 5 port 20b. In alternate embodiments, the synapse circuit 20 also includes a relatively 
small leakage conductance and capacitance that represents the membrane capacitance 
of the spine head. 

The storage element 32 will be discussed in detail below in conjunction with 
30 FIGs. 8, 10 and 11. Suffice it here to say that the storage element 32 can include a 
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short term memory portion which may be implemented as an analog circuit and a long 
term memory portion which may be implemented in a digital circuit. 

As discussed above, simulation of a pre-synaptic biological neuron causes the 
5 release of neurotransmitters from the axon terminal of the neuron. These 
neurotransmitters include the amino acid glutamate. The transmitters bind to 
corresponding receptors on the post-synaptic membrane, causing ion channels to open 
up through these receptors. Glutamate binds to three types of receptors: n-methyl-D- 
aspartate (NMDA), quisqualate, and kainate. LTP and LTD are both mediated by the 
1 0 NMDA receptors, which carry primarily Ca 2+ currents. The other receptors, termed 
the non-NMDA receptors, carry the rest of the synaptic current, consisting mainly of 
sodium ions Na + , with negligible calcium ion Ca 2+ content. These receptors are 
located on a spine head connected to the dendritic shaft. Thus, the total synaptic 
current consists of the sum of the NMDA and non-NMDA currents. 

15 

By providing synapse circuit 20 with the parallel signal paths 21a-21c, the 
synapse circuit 20 provides currents from the NMDA and non-NMDA circuits which 
are summed at terminal 20 b of the synapse circuit 20. The current through the non- 
NMDA channels in response to a pre-synaptic stimulus is given by an alpha function: 

20 

Inon = (Enon - V he ad)Kg p te t/pl Equation 8 

in which k = e/t p> e is the base of the natural logarithm, t p = 1 .5 ms, g p = 0.5nS, and 
E non = 0. It should be noted that non-NMDA receptor conductance is purely ligand 

2 5 (neurotransmitter) dependent. 

The NMDA conductance, on the other hand, is both ligand dependent, due to 
the binding of neurotransmitters released from the pre-synaptic neuron, and dependent 
on the spine head membrane 

3 0 voltage. The current through the NMDA receptors is given by: 
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WO = W„ MDA - V h€ad )g m ) ^ SfvZZ Equation 9 



where x\ = 80ms, t 2 = ,67ms, ti= 0.33nM _1 , y= 0.06m V' 1 , E N mda = 0 and g n = 0.2nS. 

5 The voltage dependence of the NMDA receptor arises from the fact that the 

receptors inhibited by Mg 2+ ions whose binding rate constant is dependent on the 
spine head membrane voltage. Near the resting membrane potential, the NMDA 
receptor channels are almost completely blocked by the Mg 2+ ions, and thus little 
current flows. As the spine head membrane becomes partially depolarized, the Mg 2+ 
1 0 ions become dislodged and more NMDA current flows. 

A non-NMDA receptor channel 34 also has a first port coupled to ports 20a 
and 20b of synapse circuit 20. The non-NMDA receptor channel 34 will be discussed 
in detail below in conjunction with FIG. 10. Suffice it here to say that the non- 

1 5 NMDA receptor channel circuit 34 itself includes a number of channels which are set 
in particular conduction states. The number of channels and the particular conduction 
states of each of the channels determines the conductance values of the non-NMDA 
current. The non-NMDA current as well as the digital expression of memory aid in 
providing the circuit having a memory characteristic that in turn influences the rest of 

2 0 the neuron circuit. 

Similarly, an NMDA receptor channel 36 has a first port coupled to ports 20a 
and 20b of synapse circuit 20. NMDA receptor channel 34 will be discussed in detail 
below in conjunction with FIG. 1 1 . Suffice it here to say that the NMDA receptor 
2 5 channel circuit controls the long term memory effects because it responds to the 
neurotransmitters and the response is provided to the post-synaptic neuron. This 
provides a desired pairing effect. 
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Referring now to FIG. 7, a calcium concentration measurement circuit 40 
which measures the concentration of calcium ions Ca 2+ in the compartmentalized 
spine head includes a transconductance amplifier 42 having a first terminal 42a 
5 coupled to receive a first signal Vhead and a second terminal 42b coupled to a 
reference voltage Vref. Amplifier 42 receives at a terminal 42c a signal from an 
NMDA receptor channel circuit, such as the NMDA circuit 36 described above in 
conjunction with FIG. 6. 



1 0 The output terminal 42d of transconductance amplifier 42 is coupled to a first 

terminal 47a of a diode connected NMOS current mirror 47 provided from a pair of 
transistors 48, 50 having drain, source and gate electrodes 48a-48c and 50a-50c, 
respectively. Transistor 48 is coupled in a diode-connected configuration. 

15 In the diode-connected circuit configuration, the gate electrode 48c of the 

transistor 48 is connected to the drain electrode 48a. Thus, the gate-to-source voltage 
equals the drain-to-source voltage (i.e. Vgs = V D s,X which for all useful gate-to-source 
voltages means the drain-to-source voltage term V D s in Equation 7 is negligible, thus 
ensuring that the transistor 48 operates in a saturation state. 



20 
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A second terminal 47b of current mirror 47 is coupled to a first terminal 51a of 
a second current mirror 51 which is here provided as a PMOS current mirror utilizing 
a pair of transistors 52, 54 having drain, source and gate electrodes 52a-52c and 54a- 
54c, respectively. 



In the NMOS current mirror 47, transistor 48 is diode-connected, and its gate 
is also connected to the gate electrode 50c of the transistor 50. Since transistors 46, 
48 share a common source, each of the transistors 48, 50 the same gate-to-source 
voltage Vgs- Hence, assuming that the drain-to-source voltage V DS of the transistor 
30 50 is large enough for transistor 50 to be saturated also, the current lour may be 
expressed as: 
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r = f!lLh-T Equation 10 



lom ~wjLi IN 



As can thus be seen from Equation 10, the current mirror 47 both "mirrors" 
and scales the input current Iin. 

5 

As mentioned above, the calcium concentration measurement circuit 40 
measures the concentration of Ca 2+ ions in the compartmentalized spine head. The 
Ca 2+ ions are the impetus for the induction of LTP or LTD. The Ca 2+ ions enter the 
spine head primarily from the NMDA channel current, which mostly consists of Ca 2+ 
1 0 ions. Thus, the flow of Ca 2+ ions into the spine head is somewhat proportional to the 
NMDA current. 

Hence, a relatively accurate measure of the Ca 2+ concentration in the spine 
head is the measure of net charge over time that flows in the NMDA current. This 

1 5 charge is accumulated in the storage and buffer circuit 56 which provides a means for 
temporarily storing the charge. Storage and buffer circuit 56 may be implemented in a 
variety of techniques one of which will be described below in conjunction with FIG. 
8. Briefly, however, the storage and buffer circuit 56 stores the signal provided from 
the current mirror 51 . The storage and buffer circuit 56 is thus provided having at a 

2 0 terminal thereof a signal level (e.g. a signal voltage level) which is proportional to the 
signal provided from current mirror 51. In this manner, the concentration of Ca 2+ ions 
can be measured by accumulating a scaled copy of the NMDA current in the storage 
and buffer circuit 56. The signal stored in the storage buffer circuit 56 thus represents 
the concentration of Ca 2+ ions. 

25 

A threshold detection circuit 58 determines when the signal stored in storage 
and buffer circuit 56 reaches a predetermined signal level. When the stored signal 
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voltage crosses certain voltage levels, the concentration of Ca ions in the spine head 
reaches certain levels thus triggering LTP or LTD. Consequently the signal voltage 
can be descriptively denoted V C a2+. Thus, threshold detection circuit 58 indicates 
when the particular levels are reached. 



Referring now to FIG. 4, the storage and buffer circuit 56 includes a capacitor 
60 having a first terminal coupled to storage and buffer circuit terminal 56a and a 
second terminal coupled to a reference potential which here corresponds to ground. It 
should be noted that the second reference voltage could also correspond to a positive 

10 or negative voltage level. A transconductance amplifier 62 has an output terminal 62a 
coupled to the first terminal of capacitor 60 and a first input terminal coupled to a 
reference voltage Vreset A bias voltage V L eak is coupled to a bias terminal of the 
amplifier 62. The capacitor 60 accumulates charge from current mirror 5 1 and thus is 
provided having voltage which is proportional to the charge. That is, the 

15 concentration of Ca 2+ ions can be measured by accumulating a scaled copy of the 
NMDA current onto the capacitor 60. The voltage stored in the temporary storage 
buffer 56 thus represents the concentration of calcium ions Ca 2+ and is modeled as a 
short term memory by the capacitor 60. For long term memory, the analog circuit is 
converted to a digital signal and can be stored in a digital storage device. The voltage 

2 0 on the capacitor can be expressed as: 



The NMDA current is mirrored and scaled by the PMOS current mirror 51. 
This current then is accumulated onto a capacitor having a first terminal coupled to 
2 5 the current mirror 5 1 and having a second terminal coupled to ground. The voltage on 
the capacitor can be expressed as 



5 




Equation 11 
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V ca- W = ^ W* (0 * + V co*- TO; Equati ° n 12 

This provides for a leakage current having a time constant determined by the 
value of g m and thus is controllable by modifying the bias voltage V LE ak of the 
5 amplifier 62 and the capacitance of the capacitor 60. The voltage Vreset determines 
the resting level of the capacitor voltage when no current is either flowing onto or 
leaking off of the capacitor 60. 

Storage and buffer circuit 56 thus acts as a membrane capacitance and leakage 
10 conductance circuit 56 which represents cell membrane capacitance. In this sense, 
capacitor 62 can be considered as being coupled between a "membrane" node and 
ground. The particular structure of the membrane node and ground is discussed 
below. In this particular embodiment, the capacitor 62 is provided having a 
capacitance value typically of about 1 picofarad (pf). There is also a leakage 
1 5 conductance in the neuron cell membrane (not shown in FIG. 8) the value of which 
can be treated as constant. 

This leakage conductance is implemented using the transconductance 
amplifier 62 connected in a follower-integrator configuration, with the output voltage 

2 0 being the membrane voltage and the capacitor 60 corresponding to the membrane 
capacitance. The input voltage of the amplifier 62 should be the resting potential 
voltage. Since there is no leakage current when the membrane voltage is at the rest 
resting potential. The value of the leakage conductance is determined by the bias 
voltage of the transconductance amplifier, which determines its g m . The use of a 

2 5 transconductance amplifier yields a relatively close approximation of the linear 
conductance. If it is desirable to increase the range over which there is an 
approximately constant conductance, a wide input range transconductance amplifier 
can be used in place of the simple transconductance amplifier 62. 



In an alternate embodiment, the leakage conductance can be implemented 
using a single transistor, having a gate voltage set to control the leakage current. This 
implementation does not emulate a true conductance however, as the current through 
5 the transistor does not vary, to first order, with its drain to source voltage. 

Nonetheless, since the leakage current is relatively small, the loss of accuracy comes 
with the benefit of a very simple and small implementation with a single transistor. 

A complete neuronal cell membrane circuit, including all of the synaptic 
1 0 circuits with the exception of the digital control circuitry, and the horizontal resistor 
circuit can be fabricated as a single integrated circuit. The digital control circuitry of 
the synaptic circuit can be implemented off chip using field programmable gate arrays. 
In one embodiment, the threshold circuitry of the synapses includes four CMOS 
buffers, each with different switching thresholds. The scaling circuitry of the 
15 dendritic circuit can be implemented off-chip using discrete components and all bias 
voltages can be set on or off chip (i.e. on-chip or off-chip voltage references can be 
used). In some embodiments, it may be desirable to utilize some off-chip voltage 
references to increase the flexibility in testing and to allow alteration of the reference 
voltages which set conductances and time constants. In other embodiments, such as 
2 0 high quantity manufacturing embodiments, it may be desirable to utilize only on-chip 
reference voltages. 

The capacitors were laid out using two layers of polysilicon that were available 
in the Orbit 2 micron process. Poly-poly capacitors have capacitances that are nearly 

2 5 independent of voltage, and thus can be operated over the full five volt voltage range. 
In contrast, poly-diffiision capacitors are highly nonlinear with respect to voltage. It 
was not critical to lay out especially precise capacitors, as they generally served to 
form a time constant with a conductance whose value could be externally set. 
Furthermore, it is not necessary to match the operating characteristics of any 

30 capacitors. 

In one embodiment, roughly 15 silicon neuron-synapse pairs can be integrated 
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on one MOSIS tinychip (die area 2.2 mm. x 2.2mm), with the Orbit 2.0 micron 
process, if the digital control circuit/memory is implemented off-chip, using FPGAs. 
If this circuitry is included on-chip, then roughly 10 neuron-synapse pairs can be 
integrated on the MOSIS tinychip. Considering that the density of an integrated 
5 circuit is roughly proportional to the square of the minimum feature size, a decrease in 
feature size to 0.25 or 0.35 micron (typical industrial process, then the number of 
silicon neuron-synapse pairs that can be integrated on a 2.2 mm. x 2.2 mm. die is 
increased by a factor of roughly 100. Thus, depending upon whether the digital 
control circuitry for the synapse is implemented off or on chip, approximately 1000 to 
1 0 1 500 silicon neuron-synapse pairs can be implemented on a die area of 2.2 mm. x 2.2 
mm. Die areas can typically be 10-100 times larger than this. However, as one 
increases the die area, and pinout, the number of circuits capable of being integrated 
may increase. 

1 5 Considering that the density of an integrated circuit is roughly inversely 

proportional to the square of the minimum feature size, a decrease in feature size to 
0.25 (typical 1997 industrial process), then the number of silicon neuron-synapse pairs 
that can be integrated on a 2.2 mm. x 2.2 mm. die is increased by a factor of roughly 
64. Thus, approximately 6400 silicon neuron-synapse pairs can be implemented on a 

2 0 die area of 2.2 mm. x 2.2 mm. The maximum 1997 chip area was approximately 100 
times larger than this. Therefore, with a state-of-the-art 1997 fabrication process, 
approximately 96,000 (15*64*100) silicon neuron-synapse pairs could be integrated. 

Referring now to FIG. 9, a threshold detection circuit 58' which may, for 
2 5 example, be provided as the type used in the manner described above in conjunction 
with FIG. 7, includes a plurality of comparators 64a-64c each of which has a first or 
negative terminal coupled to respective ones of reference voltages Vrefi - Vref3. 
When the concentration of Ca 2+ ions in the spine head reaches certain levels, LTP or 
LTD may be triggered and threshold detection circuit 58' determines when V Ca 2+ has 
30 crossed certain voltage levels. 
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In this particular embodiment, the reference voltages are set through a resistive 
network 66. A first terminal of network 66 is coupled to a first reference voltage 
VDD and second terminal of network 66 is coupled to a second reference voltage. 
Here the second reference voltage corresponds to ground but it should be noted that 
5 the second reference voltage could also correspond to a positive or negative voltage 
level. Coupled between the first and second terminals of resistive network 66 are a 
plurality of serially connected resistors 66a, 66b, 66c which provide the reference 
voltages Vrefi - Vref3- The reference voltages are thus generated by a resistive 
voltage divider 66 of the power supply voltage. This technique can be used when the 

1 0 comparators 64a-64c draw little current at the input terminals which is often a 

reasonable assumption. This technique has the advantage of dissipating a relatively 
small amount of static power and the amount of power dissipated can be reduced by 
appropriately selecting the resistance values of the resistors 66a-66c. Utilizing 
resistors having a relatively large resistance value require a relatively large amount of 

15 area on an integrated circuit while utilizing resistors having a relatively small 

resistance value require a relatively small amount of area on an integrated circuit. It 
should, of course, be appreciated that the reference voltages Vrefi -Vref3 could also be 
generated using other techniques. For example, the reference voltages could also be 
generated using band-gap or zener diodes. 

20 

In operation, each comparator 64a-64c compares the voltage signal V Ca 2+ to 
the reference voltage and produces a digital 1 if the voltage level of the signal V Ca 2+ is 
greater than the reference voltage level and a digital 0 if the voltage level of the signal 
V Ca 2+ is less than the reference voltage signal level. The comparators 64a-64c can be 
2 5 implemented via commercially available comparator circuits 



Alternatively, comparator circuits 64a-64c can be implemented via a high gain 
differential voltage amplifier having an output coupled to a digital buffer. In this 
embodiment, when the inputs of the amplifier are slightly different, the amplifier 
3 0 saturates and the output voltage is very near one of the power supply rails. The digital 
buffer then assures that a good logic value is obtained, as well as buffering the 
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amplifier output. 



A simple alternative to a complete comparator is to use only digital buffers 
(which is essentially an amplifier) to compare the voltage level of the signal Vc a 2+ to a 
5 reference voltage signal level. In this case, each digital buffer assumes the role of the 
comparator in while the voltage reference corresponds to a switching voltage of the 
digital buffer. The switching voltage of the digital buffer can be adjusted by 
appropriately changing the relative sizes of the p-channel and n-channel devices in the 
buffer. One drawback to this approach, however, is that the reference voltages are 
1 0 subject to mismatch between transistors and are not adjustable once implemented. 

Referring now to FIG. 10, a non-NMDA receptor channel circuit 34 includes a 
transconductance amplifier 68 which provides an output current I ou t(t). The output 
current Io Ut (t) can be computed as: 

15 




Equation 13 



For consistency, the voltage range used in the non-NMDA receptor channel 
circuit 34 is the same as that used in the NMDA circuit to be described below in 
conjunction with FIG. 11. This implies that the non-NMDA receptor channel circuit 
20 34 can utilize a wide input range amplifier rather that transconductance amplifier 68. 
The output current Iom(t) is then scaled and mirrored by the p-channel current mirror 
69 (which is required since the output voltage of the amplifier is near the supply 
voltage) and provided to a control circuit 70 provided from a set of conductance 
transistors 70a - 70N. 

25 

The conductance transistors 70a - 70N form what is essentially an n-channel 
current mirror with multiple legs, in the form of a simple digital-to-analog converter. 

25 



The legs of the current mirror contain control transistors 70a - 70N that turn on or off 
each leg of the conductance. With this technique, the binary control inputs can be 
used to regulate the peak amount of non-NMDA current that flows into the spine 
head. 

5 

Each set of control input values corresponds to the different conductance 
levels associated with LTP and LTD. In FIG 10, each succeeding leg of the D/A 
converter control circuit 70 is scaled by a factor of two, so that the conductance 
changes are binary, corresponding to the control values. If the peak non-NMDA 
1 0 current is plotted as a function of spine head voltage (e.g. for a nominal set of control 
inputs), ideally, the slope of the curve should be constant, as the non-NMDA 
conductance is not a function of the spine had voltage. Nonetheless, the slope, and 
hence, conductance, should remain relatively constant over the range of spine head 
voltages. 

15 

In biological neurons, the conductance changes associated with LTP and LTD 
occur smoothly in value and time. However, in the non-NMDA receptor channel 
circuit 34 of the present invention, the conductance changes in discrete steps. 
Although in this particular embodiment only two control signals C 0 , Ci are shown, it 

2 0 should be appreciated that circuitry to accommodate more control signals could be 
added to increase the number of different conductance levels. As the number of 
control signals increase, the size of the discrete steps in conductance values decrease, 
and thus the circuit more closely approximates the smoothness of real neurons. Since 
more area on an integrated circuit is required to accommodate the control circuitry, a 

2 5 trade-off must thus be made between silicon area to accommodate the desired number 
of transistors and desired precision and smoothness of the conductance values. The 
current through the legs of the control circuit 70 charges a capacitor 71. When 
charged, the capacitor 71 holds a voltage Vh ea d at a node 72. 

30 Recall that induction of LTP or LTD, and hence the regulation of the control 

inputs in the non-NMDA circuit, is determined by the ionized calcium level 
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concentration in the spine head. The control signals C 0 , Ci, which are digital in 
nature, are thus determined in part by the threshold detection circuitry in the manner 
discussed above in conjunction with FIGs. 7 and 9. The output of threshold signals 
TH 0 , THi and TH 2 of the detection circuit 58' are manipulated digitally, using 
5 information about the current conductance value, to produce the control inputs for the 
non-NMDA circuit 34. 

In a preferred embodiment, the threshold signal levels THo - TH2 are provided 
to a digital control circuit 75 via digital inverters 74a - 74c rather than via the 

1 0 comparator - resistive network approach described above in conjunction with FIG. 9. 
The digital inverter approach results in a circuit which utilizes less power and can be 
implemented in less area on an integrated circuit than the comparator approach. In the 
digital inverter approach, each of the inverters 74a-74c is coupled to a reference 
voltage Vca2+ at a node 73 and to a first terminal of a capacitor 76. The reference 

1 5 voltage Vca2+ is provided by the NMDA receptor channel circuit 36 described below 
in conjunction with FIG. 1 1 . A second terminal of the capacitor 76 is coupled to a 
second reference potential. Here the second reference voltage corresponds to ground 
but it should be noted that the second reference voltage could also correspond to a 
positive or negative voltage level. 

20 

The digital control circuit 75 receives the signals THo, THi and TH 2 from the 
detection circuit 58',processes the signals TH 0 , THj and TH 2 in a manner to be 
described below in conjunction with FIG. 12 and provides the control signals C 0 , C\ to 
the control terminals of the conductance transistor control circuit 70. 

25 

The induction of LTP is characterized by a prolonged increase in the 
conductance of the non-NMDA receptor channel, while the induction of LTD is 
characterized by the decrease in conductance of the non-NMDA receptor channel. 
This is achieved in the conductance transistor control circuit 70 by the control signals 
30 C 0 , C] which bias the respective transistors 70a - 70N into conduction or non- 
conduction states. The digital control circuit 75 determines the signal levels of the 



control signals C 0 , Q which turn on or off the conductance transistors 70a - 70N and 
thus control current flow through the circuit legs provided by the transistors 70a - 
70N. 



5 LTP and LTD are initiated when the concentration of Ca 2+ ions in the spine 

head reach certain levels. The calcium concentration measurement circuit and 
threshold detection circuits discussed above in conjunction with FIGs. 7-9 perform the 
functions of measuring the concentration of Ca 2+ ions in the spine head and 
determining when it has reached certain levels. The outputs of the threshold detection 

10 circuit 58 (FIG. 7) and 58' (FIG. 8) are digital values. These digital signals are then 
used to determine the value of the control inputs, Cj and C 0 , in FIG. 10. Thus the 
value of the non-NMDA conductance can range from its most depressed state, when 
Ci=Co=0, to its most potentiated state, when Ci=C 0 =l. The manner in which this is 
done depends upon the type of algorithm for LTP/LTD that is being implemented and 

15 is discussed below in conjunction with FIG. 12. 

A cascaded follower-integrator circuit 77 is coupled to amplifier 68 and will 
be discussed in detail below in conjunction with FIG. 10A. Suffice it here to say that 
the follower-integrator circuit 77 receives a pre-synaptic input signal and provides an 
2 0 output signal which approximates the function: Kgpt _t/Tp . 

Referring now to FIG. 10A, a cascaded follower-integrator circuit 77' which 
acts as an RC delay line and provides a time varying current circuit function is shown. 
As discussed above, the NMDA and non-NMDA channels open in response to a pre- 
2 5 synaptic stimulus of the action potential of another neuron. For each stimulus, current 
flows according to Equations 3 and 4. The time dependence for each of these 
equations can be represented as an alpha function. These can be treated as the 
impulse responses of the spine head channels to a pre-synaptic stimulus. The Laplace 
transform of both impulse responses can be written as 

30 
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For the non-NMDA channel in some embodiments x\ may be provided having 
the same value as T2. It should be appreciated, however, that in other embodiments xi 
may be provided having a value which is different than 12. 

The current I(t) can be implemented in a number of ways. As shown in FIG. 
10A, one technique to approximate the alpha function behavior is to apply a pre- 
synaptic input signal to a pair of cascaded follower integrators 78, 80. The output of 
the second follower integrator 80 is connected to a control electrode of a transistor 84. 
The transistor 84 is, in this particular example, implemented as an NMOS transistor 
84 and the control electrode corresponds to the gate electrode of the transistor 84. The 
transfer function from input to the voltage on the gate electrode of the transistor 84 is 
given by: 

Vos/Vin = l/((l+xis) (1-Hc 2 s)) Equation 15 

If the input voltage is a unit impulse, then the gate voltage on the NMOS 
transistor 84 will change incrementally like an alpha function. If this change in gate 
voltage is small, the incremental change in current through the transistor will be 
approximately 

M(t) = g m Acs Equation 16 

Thus, if the change in V G s is an alpha function, then, to first order so will the 
change in I(t). Of course, since the current through the NMOS transistor is changing 
exponentially, because it is in subthreshold, this linearized model of the transistor is 
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valid for only small changes in V G s. While V G s may change enough to violate this, 
Equation 16 is still a good first order approximation of the change in current through 
the transistor. However, the inherit nonlinearities of CMOS transistors limit the 
accuracy to which an alpha function time dependence can be approximated. 

5 

While in practice creating an impulse is impossible, a pulse of unit area and of 
short duration is mathematically equivalent to a unit impulse as long as the duration of 
the pulse is shorter than all characteristic time constants in the circuit. Thus, if the 
pre-synaptic were a short pulse, then the incremental change in Vgs will be of the 
1 0 form of an alpha function. 

The pre-synaptic input is, however, the neuron impulse, or action potential, of 
another neuron, as discussed above. If this action potential were buffered with a 
digital buffer, the output would be short, essentially constant valued pulse as desired. 

15 

One drawback to the present embodiment is that even when there is no pre- 
synaptic input, there is current that flows through the NMOS transistor. This arises 
from the fact there is a non-zero voltage on the capacitors 81, 82. This is because the 
output voltage of a simple transconductance amplifier in the follower configuration 

2 0 does not follow the input voltage when the input is zero. To minimize this problem, 
the simple transconductance amplifiers 78. 80 can be replaced by wide output range 
amplifiers, which are capable of providing output voltages closer to ground. Even in 
this case, there will be some current, albeit smaller, even when the input voltage is 
zero. This small amount of current can either be tolerated, or can be compensated by 

2 5 providing for an optional leakage transistor circuit 86. The bias voltage for the 
leakage can be determined by sensing circuitry or it may be externally set. 

Referring now to FIG. 10B, the time varying current I(t) function can also be 
provided by using a current mirror 77" similar to that used for the non-NMDA 
30 conductance. The circuit 77" includes a plurality of transistors 77a" - 77N" each of 
which receives a respective one of control signals C 0 - C N . The value of the control 
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signals Co - C N determines which transistors are biased into conduction and non- 
conduction states and thus determines when each leg of the current mirror 69' 
conducts. 

5 The size of the transistor in each successive leg 77a" - 77N" is scaled by two 

to provide a binary implementation. The control signals C 0 - C N inputs can then be 
controlled so that the total output current approximates an alpha function. The 
accuracy of this implementation is improved by adding more legs in the current mirror 
77". One drawback of this circuit is the requirement of digital control logic to 
10 determine the control inputs. On the other hand, this implementation can potentially 
provide a very accurate approximation of an alpha function current, and no current 
flows when there is no input, unlike the use of follower integrators discussed above in 
conjunction with FIG. 10A. 

15 If the alpha function time dependence is not critical, but rather the area under 

the alpha function (i.e. the total amount of charge), then the current I(t) can simply be 
provided as a constant-value pulse of current, which could also be implemented using 
the circuit 69' but with only one control input. It should be noted, however, that such 
an implementation would be a deviation from the concept of using life-like principles 

20 in design of the neuron circuits. 

Referring now to FIG. 10C, a plot of NMD A current as a function of time 
following a single pre-synaptic stimulus is shown. As expected, the NMDA current 
approximates an alpha function. 

25 

FIG. 10D shows a further embodiment of an alpha function circuit having 
cascaded current mirrors CM1,CM2 for receiving a presynaptic input signal and 
providing an alpha output signal. 

30 Referring now to FIG. 1 1, an NMDA receptor channel circuit 36 is shown. As 

noted above in Equation 9, the conductance of the NMDA channel 36 not only varies 
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with time, but also depends upon the spine head membrane voltage. 

To implement this functional dependence on voltage, the NMDA circuit 36 
includes a differential pair circuit 88. In operation, by selecting drain-to-source 
5 voltages having a predetermined voltage level, the currents Iidiffpair and bdiffpair can be 
expressed as: 

w (y '" v> 

! x m k xT i e mYr Equation 17 



/ 2 « i c ^l e « y r Equation 18 



10 in which h corresponds to Iidifipair and I 2 corresponds to bdifipair. 

These sum of these two drain currents must be equal to the current I(t) N MDA 
through the bias transistor as shown. The current can be expressed as: 



/Equation 19 



in which the base current lb corresponds to the current ICQnmda and the node voltage 
1 5 V D p corresponds to V in Equation 1 9. 

Solving Equation 19 for the node voltage and substituting into Equations 17 
and 18 yields expressions for the currents l\, I 2 corresponding to the currents Iidiffpair, 
bdiffpair, respectively: 

20 
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Essentially, if the signal voltage V H ead is more positive than the voltage V re n 
by multiple values of nV r , the voltage V D p rises to turn transistor 88a off, so that all 
of the current goes through the transistor 88b and Iidifpair ~ hdiffpair- The analogous 
situation occurs when the voltage level of signal V re n is more positive than the voltage 

level Of Vhead- 

Coupled to the differential pair circuit 88 is a cascaded follower integrator 
circuit 90 provided from a pair of differential amplifiers 90a, 90b, a pair of capacitors 
CI, C2 and a transistor 90c coupled as shown. The cascaded follower integrator 
circuit 90 can be considered as voltage controlled resistors connected to capacitors to 
function as an RC delay line. The cascaded follower integrator circuit 90 receives a 
pre-synaptic input signal at a positive input terminal thereof. The pre-synaptic input 
signal may be digitized to an impulse signal. The cascaded follower integrator circuit 
90 operates in a manner similar to that described above in conjunction with FIG. 10A 
to generate an alpha function from an action potential of another neuron. The alpha 
function provides a response described by a^xpf-t/tj] - a 2 exp[-t/x2] where al and a2 
are empirically selected values used to reflect that integrators in electronic circuits can 
be described using functions which include time and amplitude. It should be noted 
that, generally, an alpha function includes a single exponential with time modulation. 
It should thus be appreciated the alpha function described above using two terms may 
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equivalently be expressed by a single term function or that other multiple term 
representations may also be used. 



Applying and rearranging the Equation 20 to the differential pair 88 yields: 

5 

him** = '(0 VRef-Vjfeed Equation 22 

1 + Ze nV r 

where Z is the ratio of the sizes of the transistors in the two legs of the differential 
pair. 

1 0 Idiffpair then serves as the bias current for a transconductance amplifier 9 1 . 

Assuming the transconductance amplifier 91 operates in its linear range, the output 
current is given as: 

. J jdifipair 

hut-amp = YHead ^Re/jgrn = \?Head '^JJ^^T Equation 23 

15 This current is then mirrored (with appropriate scaling) through a PMOS 

current mirror 92 back to the spine head membrane and also to the calcium 
concentration circuit described above in conjunction with FIG. 7. It should be noted 
that current mirror 92 mirrors I ou t-amp twice instead of just once. 

20 To maintain the proper exponential dependence on voltage in implementing 

Equation 4 with the NMDA circuit 34 which has a voltage dependence described by 
Equation 22, it is necessary to shift and scale the voltage ranges over which the 
circuits operate. Thus current mirror circuits 93, 94 provides a scaled down copy of 
the NMDA current W^amp that charges/discharges the capacitor 71 . As discussed 

25 above in conjunction with FIG. 10, when charged, the capacitor 71 holds a voltage 
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Vhead at the node 72. This technique represents a model in which a the flow of Ca2+ 
ions into the spine head is approximately proportional to the NMDA current. The 
current mirror 93 provides to a transconductance amplifier circuit 97 a current signal 
Ica2+ which corresponds to a scaled down version of the current signal lout-amp. 

5 

The transconductance amplifier circuit 97 acts as a voltage controlled resistor 
having a resistance value set by the reference voltage Vleak- The capacitor 76 holds 
at a node 73 a voltage level Vca2+ which is proportional the Ca 2+ ions within the spine 
head. The charge will dissipate from or "leak off of node 99 until the voltage Vca2+ 
1 0 falls to a value equal to Vresj. This is the mechanism by which transient pulses in the 
CA 2+ can return to nominal signal levels. 

Typically, the spine head voltage varies between -80 mV and 0 mV. For 
convenience, the biological 0 V is again chosen to be 2.5 V. Thus, typically there is a 
15 2.5 V shift between an actual biological channel and the electronic implementation. 
The voltage range must also be scaled to maintain the same behavior in the 
exponential. From Equations 4 and 22, it is apparent that 

, Equation 24 

2 0 where x is the ratio of the electronic implementation voltage to the actual biological 
voltage. For typical values of n, x should be approximately 2. In other words, while 
the biological voltage changes over a range of approximately 80 mV, the actual 
implementation will vary range of 160 mV. Formally, the voltages are related 
according to: 

25 

Veiectionic = 2V b i 0 iogicai + 2.5V Equation 25 

Thus, the spine head voltage, in the electronic implementation, will vary from 
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approximately 2.34 V to 2.5 V. This implies that the voltage signal V Re f in FIG. 1 1 
should equal about 2.5 V. Also, since the differential input of the transconductance 
amplifier is potentially up to 160 mV, greater than the linear range of the simple 
transconductance amplifier, it is best to replace the simple transconductance amplifier 
5 with one with a wide input range, having a linear range of nearly 200 mV. 

Examination of the voltage dependence of NMDA current produced by the 
NMDA circuit 36 reveals that for lower values of spine head voltage, corresponding 
to negative highly polarized values of biological potential, the magnesium ions block 
1 0 the NMDA channel and the current is small. As the spine head becomes depolarized 
(to a more positive potential), the NMDA channel conducts more. When the spine 
head voltage gets very close to its resting potential (biological = 0 mV; electronic = 
2.5 V) very little currently flows because the voltage gradient is relatively small. 

1 5 Referring now to FIG. 1 1 A, a plot of non-NMDA current as a function of time 

following a single pre-synaptic stimulus is shown. As expected, the non-NMDA 
current approximates an alpha function with the peak value occurring at a time which 
is earlier than the time at which the peak value of the NMDA current occurs (FIG. 
10C). 

20 

Referring now to FIG. 12, a digital control circuit 59 for induction of LTP and 
LTD receives from a threshold circuit the threshold signals TH 0 - TH 2 at respective 
ones of input ports 59a - 59c and provides control signals C 0 , Q having appropriate 
signal levels at output ports 59d, 59e. The threshold signals may be provided in any 
2 5 appropriate manner. For example, the threshold signals THo - TH2 may be provided 
from any of the threshold circuits described above including those described in 
conjunction with FIGs. 5, 7, 9 and 10. 

As discussed above, the induction of LTP is characterized by a prolonged 
30 increase in the conductance of the non-NMDA receptor channel, while the induction 
of LTD is characterized by the decrease in conductance of the non-NMDA receptor 
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channel. This is achieved in the non-NMDA channel circuit 34 (FIG. 10) by the 
control signals Co, Ci turning on or off the legs of the conductance transistors 72 (FIG. 
10). The digital control circuit 59 receives the threshold signals TH 0 - TH 2 and 
determines the value of the control signals Co, C\ and thus determines the induction of 
5 LTP and LTD. 

LTP and LTD are initiated when the concentration of Ca 2+ ions in the spine 
head reach certain levels. The circuitry discussed in calcium concentration 
measurement circuit 40 (FIG. 7) measures the concentration of Ca 2+ ions in the spine 

10 head and then determines when it has reached certain levels. The threshold circuit 
provides digital values signals which are used to determine the value of the control 
inputs, Ci and Co, in FIG. 10. Thus, the value of the non-NMDA conductance can 
range form its most depressed state, when Ci=C 0 =0, to its most potentiated state, 
when Ci=Co=l . The manner in which this is accomplished depends upon the type of 

1 5 algorithm for LTP/LTD that is being implemented. 

One theory of the induction of LTP or LTD is that the conductance value of 
the non-NMDA current depends solely on the concentration of Ca 2+ ions, regardless of 
the initial conductance state. Under this theory, the changes in conductance values are 

2 0 triggered by crossing one of the thresholds, Th0-Th3. It should be noted that if none 

of the thresholds are crossed, then the conductance is in the nominal state. Depression 
of the conductance value is triggered only when the calcium concentration rises above 
the first threshold. This is because LTD can only be initiated when there is a stimulus 
(low-frequency). If there is no stimulus, there should be no reason for LTD (or LTP) 
25 to be initiated. 

The truth table for this technique is shown in Table II. The signals Tho - Th 2 
correspond to the output signals of the threshold detection circuitry described above in 
conjunction with FIGs. 5-1 1C. With this particular technique, with only two control 

3 0 inputs Ci and Co, only three threshold values are necessary. It should be appreciated, 

however, that when more than two control input signals are provided an appropriate 

37 



number of threshold values are used. Thus in any application, the number of 
threshold values used are dependent upon the number of control signals used and vice 
versa. 

5 Note that many of the rows of the truth table are "don't care." This is because 

the combinations of the signal Th2-Th0 in those rows are not possible, since the 
signals Th2-Th0 are correlated with one another. For instance, if the signal Th2=l, 
then that requires that Th 1 =1 and ThO=l . 
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TABLE II 



Th2 


Thl 


ThO 


CI 


CO 


Level of 
Potentiation 


0 


0 


0 


0 


1 


Normal 


0 


0 


1 


0 


0 


Depressed 


0 


1 


0 


* 




Don't Care 


0 


1 


1 


1 


0 


Potentiated 


1 


0 


0 


* 


* 


Don't Care 


1 


0 


1 


* 


* 


Don't Care 


1 


1 


0 


* 


* 


Don't Care 


1 


1 


1 


1 


1 


Most Potentiated 



From this table, logic expressions for C\ and C 0 can be derived in terms of Th2 
- Th 0 as shown in Equations 26 and 27. 

15 

CI = TH1 • THO = TH1 Equation 26 



_ Equation 27 

CO = Th2 -Thl' ThO + ThO • Thl • Thl = 77*0 + Thl. 
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It should be noted that the control signals Ci, C 0 are not updated continuously 
in time, but rather at discrete intervals. In one embodiment, the duration of the time 
interval is the length of time for which LTP or LTD is in effect. This is accomplished 
via the digital circuits 100 included in the digital control circuit 59. The digital 
5 circuits 100 implemented the digital logic expressed by Equations 26, 27. It should be 
appreciated of course that any digital logic circuit capable of implementing the logic 
set forth in Equations 26, 27 could also be used. 

Digital signals are fed from the output ports of the digital logic circuit 100 into 
a register circuit 102. Register circuit 102 provides control signals CO, CI at the 
1 0 output ports 59d, 59e of the digital control circuit 59. The period of the clock signal 
for the register circuit 102 determines how long LTP or LTD is in effect. 

Referring now to FIGs. 13 and 13 A, in FIG. 13 a plot illustrating the 
dependence of the change in conductance on the calcium concentration is shown. One 

15 theory of LTP and LTD is that they can reverse each other. In other words, the current 
conductance state depends upon the previous conductance state. If the non-NMDA 
conductance is initially in a potentiated state, and the calcium concentration dictates 
that LTD should be initiated, then the next conductance state would be a more 
nominal level, as opposed to fully depressed. With this technique, it is the change in 

2 0 conductance, rather than the actual conductance level, that is affected by the 

concentration of calcium ions and it is this dependence which is shown qualitatively 
in FIG. 13. 

This can be expressed analytically as 

25 

G[n+1] = G[n] + AG Equation 28 

where G[n] represents the current conductance state. 



30 



FIG. 13 A is a block diagram of a circuit which implements the threshold logic 
of the LTP/LTD reversal algorithm. The four threshold outputs Th3-Th0 of FIG. 13 A, 
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can be represented by a two's complement three-bit number expressed as DG2-DG0. 
The truth table for the signals DG2-DG0 is shown in Table III. 



TABLE HI 

5 



Th3 


Th2 


Thl 


ThO 


DG2 


DG1 


DGO 


Level of 
Potentiation 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


1 


1 


0 


-2 


0 


0 


1 


1 


1 


0 


1 


-1 


0 


1 


1 


1 


0 


0 


1 


+1 


1 


1 


1 


1 


0 


1 


0 


+2 



The signals DG2-DG0 represents a change in CI -CO ranging from -2 to +2. 
From this truth table, logic expressions for DG2-DG0 can be derived in terms of Th3- 
1 0 ThO and expressed as: 

G[n+1] = G[n]+AG Equation 29 



DG2 = Th2>ThO 

Equation 30 

15 DGO = Th3 BAR + Thl Equation 31 



The reversal circuit 59' implements the LTP/LTD reversal algorithm. 
Reversal circuit 59' includes as threshold logic circuit 1 10 which receives threshold 
signals THO - TH3 and provides digital output signals DG0-DG2. The signals DGO- 



DG2 are fed to and FSM logic circuit 1 12. The output of the FSM logic circuit 1 12 is 
coupled to a register 1 14. The output of register 1 14 are the current conductance state 
control signals CI and CO. The current conductance state control signals CI and CO 
coupled back to the input to the FSM logic circuit 1 12. When coupled in this manner, 
5 the output signals CN0-CN1 of the FSM logic circuit 1 12 correspond to the next 
control signals, CN1 and CNO which are fed into the register circuit 1 14 which is 
clocked by a signal having a period which determines the length of LTP or LTD. 

The truth table for the FSM logic circuit which calculates the signals CN1 and 
1 0 CNO is shown in Table IV. 



TABLE IV 



Cl 


CO 


DG2 


DG1 


DGO 


CN1 


CNO 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


1 


0 


0 


1 


0 


I 


0 


0 


0 


0 


1 


1 


0 


0 


0 


0 


0 


0 


1 


0 


1 


0 


0 




0 


0 


0 


0 


1 


0 




0 


0 


1 


1 


0 


0 




1 


0 


1 


0 


0 


0 




1 


1 


0 


0 


0 


0 




0 


1 


0 


1 


1 


1 


0 


0 


0 


0 


1 


0 


1 


0 


0 


0 


1 


1 


1 
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1 


0 


1 


0 


1 


0 


1 


1 


0 


1 


1 


0 


0 


0 


1 


0 


0 


1 


0 


1 


1 


1 


1 


0 


0 


0 


1 


1 


1 


1 


0 


0 


1 


1 


1 






1 


0 


1 


1 


0 






1 


1 


0 


0 


1 






0 


1 


0 


1 


1 



From the Table IV truth table, logic expressions for CN1 and CNO can be 
derived and may be expressed as: 



CN1 «= C\ DG% DG\ + C0'DG2 DG$+DG2 DGI DGQ + C\ C0 DQ1DGQ Equation 32 
' = 5C2«(C1-DgT+.C0 DG0 + DG1 DGO) + CI CQ DG2-DG0 

5 

CNO o 5ra ci C0 + cra i^ .l>G^ Equation 33 

CI Dtt-DGl + CQ DG2DG1 + C1 C0DG2 DGO 

= (C1 + C0)vOG2jDGI +C1 C0(D^ + DGl) + ^Z>GK)(Cl+5OT) + C0vD^D^.D^ 

Referring now to FIG. 14, a bias circuit which produces bias voltages at the 
gates of the pass transistors of the horizontal circuit. The bias circuitry must adjust 
1 0 the gate voltage such that V q defined in Equation 34 is held constant even when the 
node voltages Vi and V 2 change. FIG. 14 illustrates this function for the signal 
voltage VGL An identical circuit with V2 as the input generates the signal voltage 
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VG2. 



V q = Vgi - V! = V G2 - V 2 Equation 34 

5 The horizontal resistor bias circuit is essentially a transconductance amplifier 

connected in the follower configuration, with the addition of the diode connected 
transistor Md. The gate voltage of transistor M2 follows the voltage VI . The voltage 
VGI is thus equal to the voltage VI plus an offset equal to the voltage across the 
diode connected transistor Md. This offset is the voltage required to maintain the 
1 0 current through transistor Md, which is half of the bias current lb. By Equation 34, 
this offset is in fact equal to V q . The current through transistor Md can be expressed 
as: 

Equation 35 

The dependence on the drain voltage in Equation 6 is negligible since the 
15 transistor is diode connected. Hence, Equation 35 relates V q to the bias current lb- 

That is, setting the gate voltage of the bias transistor Mb determines the signal voltage 
V q , independent of Vj or V 2 . This in turn determines the resistance of the horizontal 
resistor connection. An expression for the effective resistance of the connection that 
is solely dependent on I b and the thermal voltage may thus be written as: 

20 

R = 4nV T /l b Equation 36 

Since the current I b depends exponentially on the gate voltage of the transistor 
Mb, the effective resistance of the horizontal resistor connection can vary over many 
2 5 orders of magnitude. In operation, as the bias voltage increases, more current flows, 
corresponding to a decrease in effective resistance. 
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Examination of the current I of the horizontal resistor configuration as a 
function of V1-V2 reveals that for values of V1-V2 less than approximately 100 
millivolts, the slope of the curve is relatively constant, corresponding to a constant 
effective resistance given by Equation 36. For values of Vi-V 2 greater than 100 
5 millivolts in magnitude, the current saturates, and the circuit loses its linear resistive 
behavior. 

This 100 millivolt linear range of the horizontal resistor configuration may not 
be enough in certain applications. However, multiple horizontal resistor circuits can 
10 be placed in series to increase the range over which the circuits behave like a constant 
resistance. 

The horizontal resistor circuit is a practical and flexible way to implement the 
dendritic resistance of then neuron. A single connection may suffice, although 
1 5 multiple circuits may be cascaded to increase the linear resistive range. However, this 
may not be necessary since the spine head voltage and the neuron cell voltage do not 
differ much in voltage, except at the instance of an action potential, which is of 
relative short duration. Thus the saturation of the resistor current at this time may be 
within an acceptable tolerance range. 

20 

Referring now to FIG. 14A, a scaling circuit 130 includes a first operational 
amplifier (op-amp) 132 connected in the unity buffer configuration and having a first 
input signal V mem coupled to the positive input of op-amp 132 and having a second 
input voltage Vheadout set equal to the output voltage Vj coupled to the negative 
2 5 input terminal of op-amp 1 32. The buffer configuration is used so that the scaling 
circuit 130 does not load the other circuitry and draw current from it. 

A second op-amp 134 is also connected in the unity buffer configuration. Its 
input voltage is one half of the power supply voltage, created by the resistive divider 
30 network 136 provided from resistors Rl. The op-amp 134 generates a reference 

voltage V re f at the output port thereof. When the supply voltage Vsupply is set equal 
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to 5 volt, for example, the signal voltage V re f equals 2.5 volts. 

The op-amps 138, 140 are each connected in the differential amplifier 
configuration. The output voltage of op-amp 138 is provided as: 




Equation 37 



while the output voltage of op-amp 140 is similarly provided as: 

R 

Vheadin « Vr</~ V 2 = V Rg/ -^(V Rt/ - V HBA00UT ) Equation 38 

It should be appreciated that although amplifiers 132 - 138 are here shown as 
operational amplifiers, any amplifier having a relatively large gain and a relatively 
small output resistance (e.g. a MOS amplifier) can also be used. It should also be 
appreciated that it may be desirable to fabricate the scaling circuit 130 as a portion of 
an integrated circuit. In some applications, however, the scaling circuit may be 
implemented using discrete, off-chip, components. 

The dendritic circuit connects the neuron membrane circuits to the spine head 
or synaptic circuits discussed above. However, these two different groups of circuits 
operate over different voltages ranges. Both voltage ranges possess the same ground, 
or reference, voltage, equal to 2.5 volts. However, the neuron membrane circuits 
operate over a range that is five times as big as the range for the spine head circuits. 
Recall that this difference in voltage scale resulted from the different exponential 
dependence on voltage that the two different types of circuits exhibited. Since the 
neuron membrane circuits are connected to the spine head circuits through the 
dendritic resistance, this difference in voltage scales is a problem. 



However, it should be noted that the spine head node in the circuits in FIG. 9 
are connected to the gates and drains of the transistors and that such connections to the 
transistor gates are essentially the inputs of the circuit, while the connections at the 
5 transistors drain serve as the outputs. Consequently, these output signals essentially 
behave like current sources. That is; the output current is negligibly affected by the 
head voltage at these drain connections. Thus, at the drain connections, the voltage 
scale does not really matter and can therefore be on the same scale as neuron cell 
membrane circuit. 

10 

The spine head input connections at the transistor gates must be on the voltage 
scale given by Equation 25 for the spin head circuits. FIGs. 10 and 1 1 show the 
NMDA and non-NMDA circuits with the input spine head nodes (HEADIN) and the 
output nodes (HEADOUT). 

15 

The HEADOUT node can be connected to one end on the horizontal resistor 
network, with the other end connected to the neuron cell membrane. The HEADIN 
voltage must be scaled version of the HEADOUT voltage to achieve the necessary 
voltage scale. In particular HEADIN must be related to HEADOUT according to 

20 

v headin - V Ref " v headout) Equation 39 



where V Re f is equal to 2.5 volts. This behavior can be implemented by using the 
scaling circuit 130 circuit 130. 

2 5 FIG. 15 shows a circuit block diagram of an LTP/LTD controller circuit 200 in 

accordance with the present invention for controlling the conductance value in the 
synapse circuit. The controller circuit 200 can provide control signals C<j>-5 for each 
synapse in a multi-synapse circuit on a time-shared basis, such as the non-NMDA ion 
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channel circuit of FIG. 15A which is similar to that shown in FIG. 10 described above. 



In an exemplary embodiment, the controller circuit 200 includes a threshold 
circuit 202 having first and second threshold voltage inputs Vt^Vtm, which 
5 determine the respective threshold voltages that V Ca 2+ must exceed in order for the 
mechanisms behind the onsets of LTD (V™) and LTP (V T hi) to turn on. The 
capacitor Cc a 2+ can correspond to capacitor 76 shown in FIG. 11. The current flowing 
into capacitor Cc a 2+ produces the voltage V Ca 2+ , which represents the total internal 
synaptic calcium concentration that accumulates over time, as described in detail 
1 0 above. In one embodiment, the first and second threshold voltages V™, Vtho are 
constants set off-chip via two pins, for example, on the integrated circuit. In an 
alternative embodiment, the first and second threshold voltages V T ho,V T hi can be 
dynamically modulated by additional synaptic circuitry for achieving sliding threshold 
voltages. 

15 

A potentiation discharging and discharging circuit 204 and a depression 
discharging and charging circuit 206 are coupled to the threshold circuit 202. A 
potentiation capacitor Cpot is coupled to the potentiation discharging and charging 
circuit 204. Similarly, a depression capacitor C D ep is coupled to the depression 

2 0 discharging and charging circuit 206. In one embodiment, the depression capacitor 
Cdep, is relatively large as compared with the potentiation capacitor C PO t, and 
therefore charges more slowly. In biological synapses, the mechanism for potentiation 
operates at a much faster rate than the corresponding mechanism for depression. This 
fact is expressed in the VLSI synapse by making the potentiation capacitor 

2 5 correspondingly smaller than the depression capacitor, so that it charges up at an 
appropriately faster rate. 

The charging portion of the potentiation discharging and charging circuit 204 
is attached to the potentiation capacitor C P ot, which is the VLSI representation of the 
30 biophysical mechanism behind LTP. The charging portion of the depression 

discharging and charging circuit 206 is attached to the depression capacitor Cdep, 
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which is the VLSI representation of the mechanism behind LTD. The voltage on the 
potentiation and depression capacitors represents the accumulated amount of 
potentiation and depression, respectively, that have occurred in the synapse starting 
from the point in time when these capacitors were last discharged. 

5 

The circuit 200 further includes a counter circuit 208 coupled to the 
potentiation and depression discharging and charging circuits 204,206. A potentiation 
detector circuit 210 is coupled between the potentiation capacitor Cpot and the 
counter circuit 208 and a depression detector circuit 212 is coupled between the 

1 0 depression capacitor C D ep and the counter circuit 208. Respective P disch arge and 

Discharge signals connect the respective potentiation and depression discharging and 
charging circuits 204,206 to the counter circuit 208. The counter circuit 208 can be 
implemented either on-chip or off-chip, as indicated by the dashed line, in hardware or 
in software. In addition, it is understood that circuitry to the left of the dashed line 

15 will be provided for each synapse and that circuitry to the right of the dashed line, e.g., 
the counter, can be coupled to a plurality of synapses. 

FIG. 16 shows an exemplary circuit implementation of the circuit 200 of FIG. 
15. The threshold circuit 202 includes a first current mirror 214 formed from 

2 0 transistors Ml -4 in a configuration similar to that shown in FIGS. 6 and 7, for 

example. The first current mirror 214 compares the voltage V Ca 2+ on the capacitor 
C Ca 2+ to the second threshold voltage level V™ (LTP). When the voltage is greater 
than the first threshold voltage level V-mo, the P C har g e transitions to the active.state, e.g., 
a logical one. The threshold circuit 202 further includes a second current mirror 216 

2 5 formed from transistors Ml 1-14 for comparing the voltage Vc a 2+ to the first threshold 
voltage Vrho(LTP). When the second voltage level V T hi is exceeded, the D C har g e signal 
transitions to the active state. In general, the second voltage threshold Vihi (LTP) is 
higher than the first voltage threshold V T ho (LTD) as described below in conjunction 
with FIG. 17. 



The potentiation discharging and charging circuit 204 includes transistors M5- 
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6 coupled so as to selectively charge the potentiation capacitor C P ot under the control 
of the Pcharge signal from the threshold circuit 202. In one embodiment, a logical one 
on the Pcharge signal (V Ca 2+ > V T hi), initiates charging of the potentiation capacitor 
CpoT- The potentiation discharging and discharging circuit 204 further includes a 
5 transistor M7 coupled in parallel with the potentation capacitor C PO t for discharging 
the capacitor when biased to the conductive state by a Pdischarge signal. The depression 
discharging and charging circuit 206 includes transistors Ml 5- 16 for allowing the 
depression capacitor C D ep to charge under the control of the D cha rge signal from the 
threshold circuit 202. A further transistor Ml 7 in parallel with the depression 
1 0 capacitor Cdep provides a discharge path for the capacitor under the control of the 
Discharge signal. The counter 208 activates the Discharge signal at the end of given 
cycle, for example, to discharge the depression capacitor C D ep prior to the beginning 
of a subsequent cycle. 

1 5 The potentiation detector 2 1 0 can include first and second transistors M8-9 

coupled in a CMOS inverter configuration. The detector 210 can further include a 
transistor M10 controlled by a P rea d signal for adjusting the level of the POT signal, 
which is provided to the counter 208. The depression detector 212 includes three 
transistors M18-20 coupled in a similar manner as M8-10 with a D rea d signal coupled 

20 to the transistor M20. 

When the calcium concentration voltage Vc a 2+ is below the first and second 
voltage thresholds V™ and V T m ,the mechanisms for LTP and LTD are both off and 
the threshold circuit 202 sets the Pcharge and Dcharge signals to a logic 0. This turns 
2 5 off the charging of both the potentiation capacitor Cpot and the depression capacitor 
Cdep- 

FIG. 17 shows the relationship of V Ca 2+ with respect to the LTP/LTD process. 
The synaptic calcium concentration V Ca 2+ falls within one of four horizontal regions 
30 defined by the voltage thresholds V T ho,VThi: (1) no change; (2) movement towards 
LTD; (3) movement towards LTP/LTD cancel out; and (4) movement towards LTP. 
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Each of these regions causes the plasticity of the synapse to change in a different way. 
When V Ca 2+ is less than both V T ho and V T hi, there is no change in the plasticity of the 
synapse. In the case where V Ca 2+ rises to exceed only V™, the threshold circuit 202 
sets node D char ge high. This causes "charging" of the depression capacitor C D ep to 
b occur. Since V Ca 2+ remains below V-mi, however, the P C har g e signal stays low and there 
is no "charging" of the potentiation capacitor Cpot so that the mechanism behind LTD 
is on while the mechanism behind LTP is off. This corresponds to region (2) in which 
the plasticity of the synapse moves toward LTD. 

As V Ca 2+ continues to rise and exceeds V T m, region (3) is entered in which the 
threshold circuit 202 sets the P C har g e signal to the high logic state such that the 
potentiation capacitor Cpot begins to charge. At this point in time, the depression 
capacitor C D ep has been charging during the time it took V Ca 2+ to rise from V T ho to 
Vrhi. In this time interval, it has thus accumulated a significant amount of new 
voltage. Since the potentiation capacitor is significantly smaller than the depression 
capacitor, however, the voltage on the potentiation capacitor quickly matches the 
amount of voltage the depression capacitor has accumulated. As a result, the 
movement of the plasticity towards LTP and LTD approximately cancel out. Finally, 
as V Ca 2+ rises well above V™ the faster potentiation mechanism dominates and the 
plasticity moves towards LTP. 

Referring again to FIG. 16, the controller circuit 200 of the present invention 
emulates the biological process described above. The voltage V Ca 2+ generates an 
exponentially increasing subthreshold channel current in transistor M3. This current 
25 is compared at node P C har g e to the exponential current generated in M4 by the constant 
reference voltage V™. If V Ca 2+ is greater than V™, then the parasitic capacitance at 
Pcharge collects current until its voltage is equal to that of the power supply Vdd. If on 
the other hand, V Ca 2+ is less than V™, then node P C harg e is pulled down to ground. A 
high of Vdd serves to turn on M6 while a low of gnd turns it off. Whenever M6 is on, 
30 charge is collected on the relatively small potentiation capacitor Cpot- This capacitor 
"remembers" voltage created by the accumulated charge, even when M6 goes off 
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(except for a relatively small loss due to leakage). When the voltage on the 
potentiation capacitor Cpot gets high enough, the inverter switches and the POT signal 
transitions to a logic one (i.e. Inv(Pot) goes to zero). The depression detector circuit 
212 operates in an analogous fashion. In this case, when enough charge is 
5 accumulated on the depression capacitor C D ep to switch the inverter, the DEP signal 
goes high. It is understood, however, that in general the depression capacitor Cdep 
begins charging before the potentiation capacitor C P ot since the first voltage threshold 
Vjho is less than the second voltage threshold V T hi. 

Referring to FIG. 15B, the counter circuit 208 can service a number of circuits 
on a time shared basis under the control of a time share circuit 213, which loads 
synapse values (C0-5) into the counter. More particularly, the counter 208 samples 
the conductance value (CO-N) of each of the synapses to which is connected, such as 
the non-NMDA circuit of FIG. 15 A, which is similar to that shown in FIG. 10. The 
counter adjusts the level of potentiation/depression in the synapses based upon the 
states of the POT and DEP signals. It is understood that a variety of counter circuits 
having a predetermined maximum count value can be used to provide a selected level 
of resolution for the Vc a 2+ signal level of the synapse. It is further understood that one 
of ordinary skill in the art can replace the counter circuit with other known circuits 
that are effective to selectively adjust the conductance level of the non-NMDA 
circuits. 

In one embodiment, the counter circuit 208 includes a six bit up/down counter 
having input/output signals C0-5. The 6-bit counter 208 samples each of the synapses 
25 on the chip in a merry-go-round fashion, for example. One of ordinary skill in the art 
can readily determine a desired sampling rate based upon a selected operating time 
scale and time constant rate, which is dominated by the RC networks containing 
capacitors, e.g., C Ca 2+ , Cdep, and Cp OT . For each sample of a synapse, the counter 208 
loads the current conductance state of the synapse, i.e., C5 C4 C3 C2 CI CO, under the 
3 0 control of the time share circuit 213. The state of the POT and DEP signals from the 
detector circuits 210,212 determine whether the counter value is incremented, 
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decremented or left the same. Where POT=l and DEP=0, the count is incremented by 
one (out of a total number of count states of 2 6 =64), resulting in the synapse being 
potentiated by one level (out of a total of 64). If POT=0 and DEP=1 then the reverse 
occurs and the count is decremented by one, resulting in the synapse being depressed 
5 by one level. If on the other hand, POT=0 and DEPO or POT=l and DEP=1, then 
the counter value is left the same and the plasticity state of the synapse does not 
change. 

By adjusting the count value in the counter, the control signals CO-5 can be 
1 0 adjusted to alter the number of electrical pathways that are conductive, i.e., the 

conductance level, in the non-NMDA ion channel circuit (FIG. 15 A). The state of the 
respective control signals CO-5 control the conduction state of the switching element 
to which it is connected. By controlling the switching element, the electrical pathways 
can be made conductive or non-conductive to modify the synapse conductance level. 

15 

The time-shared counter 208 allows the potentiation and depression capacitors 
Cpot>Cdep to be made small enough that they can be fabricated on-chip without 
consuming too great a percentage of the synapse area. The higher the bit-count of the 
counter, the smaller the capacitors can be made, since less potentiation/depression is 
2 0 required to increment/decrement the plasticity state, i.e. there is a finer grading of the 
plasticity states. In addition, the counter combines the separate accumulated amounts 
of potentiation and depression into a change in the synapse's plasticity. 

The above-described emulation circuit, which can be implemented using VLSI 
25 fabrication techniques, models the calcium dynamics in a Hebbian synapse. The 
circuit operates by reading the calcium concentration inside of the synapse and 
modulating the conductance of the non-NMDA ion channels in a manner consistent 
with experimental data for real biological Hebbian synapses. The result approximates 
a homosynaptic LTP/LTD curve when a range of presynaptic stimulation frequencies 
30 is applied. The synapse circuit is relatively compact and low power and can be 
fabricated in large number with state-of-the-art industry semiconductor processes. 
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With digital circuitry that can be made to operate orders of magnitude faster than 
analog circuitry on a neural chip, thousands of synapses could be time-shared to a 
counter located off-chip. The counter can be implemented in software on a 
microprocessor or in hardware on FPGA's, and can interface with field programmable 
5 silicon neural systems, which can be created out of the synapses described herein. 

Having described preferred embodiments of the invention, it will now become 
apparent to one of ordinary skill in the art that other embodiments incorporating their 
concepts may be used. For example, hardware simulations of small neural networks 
1 0 using a functioning fabricated device can be performed and a biological neural 

network can be emulated. Also, experiments based on physiological principles can be 
performed to test different learning algorithms. 

At the transistor level, circuits can be designed to generate many of the voltage 
1 5 references that are needed. While some of these references are intended to be 

variable, in certain cases it may be desired that they are fixed. Also, circuits can be 
developed to emulate different types of synapses, and different learning techniques, 
including first in building an artificial neural network that emulate the analog behavior 
or real neurons. 
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Having described preferred embodiments of the invention, it will now become 
apparent to one of ordinary skill in the art that other embodiments incorporating their 
concepts may be used. It is felt therefore that these embodiments should not be 
limited to disclosed embodiments, but rather should be limited only by the spirit and 
2 5 scope of the appended claims. 



What is claimed is: 
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